INSTABILITY OF GRAPHICAL STRIPS AND A POSITIVE ANSWER TO 
THE BERNSTEIN PROBLEM IN THE HEISENBERG GROUP M 1 



One of the most celebrated problems in geometry and calculus of variations is the Bernstein 
problem, which asserts that a C 2 minimal graph in M 3 must necessarily be an affine plane. 
Following an old tradition, here minimal means of vanishing mean curvature. Bernstein [BeJ 
established this property in 1915. Almost fifty years later a new insight of Fleming |Flej sparked 
a major development in the geometric measure theory which, through the celebrated works 
|DG3j . |Alj . |Simj . |BDG| culminated in the following solution of the Bernstein problem. 

Theorem 1.1. Let S = {(x,u(x)) £ M, n+1 \x S R n ,x n+ i = u(x)} be a C 2 minimal graph in 
R n+1 , i.e., let u £ C 2 (R ra ) be a solution of the minimal surface equation 



in the whole space. If n < 7, then there exist a £ W 1 , (3 £ R such that u{x) =< a, x > +(3, 
i.e., S must be an affine hyperplane. If instead n>8, then there exist non affine (real analytic) 
functions on R n which solve Q1.1JI . 

The purpose of this paper is to study, in the simplest model of a sub-Riemannian space, 
the three-dimensional Heisenberg group H 1 , the structure of C 2 minimal graphs with empty 
characteristic locus and which, on every compact set, minimize the horizontal perimeter. As 
a corollary of our results we obtain a positive answer to a sub-Riemannian analogue of the 
Bernstein problem. From the perspective of geometry the relevance of H 1 lies in the fact that 
this Lie group constitutes the simplest prototype of a class of graded nilpotent Lie groups 
which arise as "tangent spaces" in the Gromov-Hausdorff limit of Riemannian spaces, see |Bej . 
|Grolj . [Gro2j . |Monj . |CDP T . Furthermore, W 1 is an interesting model of a metric space with 
a non-trivial geometry. 

The Bernstein problem in H 1 has recently received increasing attention, see |GP| . CHMY , 



PI] . EED, EE2, jEEl, HSY1, |DGN2| . jUSl, [HHY| . [ESV] . While we refer to the discussion 



below, to section|2 and to the cited references for a detailed description of the relevant geometric 
setting, it seems appropriate here to provide the reader with some historical perspective and a 
brief overview of the main contributions of the present paper. 

When approaching the sub-Riemannian Bernstein problem one is confronted with the fact 
that there exists smooth entire minimal graphs which are not affine. For instance, in H 1 the 
surface S defined by t = xy/2 is minimal, in the sense that its H-me&n curvature, defined in 
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(|2.1Uf) below, vanishes identically. This is of course in sharp contrast with Theorem ll.il What 
lurks in the dark here are two aspects: (i) On the one hand, the so-called characteristic locus of 
the surface S, i.e., the collection of points at which the fiber of the subbundle generated by the 
horizontal distribution coincides with the tangent space of S: on this set the horizontal Gauss 
map becomes singular (for instance, the surface t = xy/2 has non-empty characteristic locus); 
(ii) The drastically different nature of the relevant minimal surface equation, with respect to the 
classical case. The classical minimal surface equation (|1.1|) is a quasi-linear elliptic equation, 
whereas in Mr, away from the characteristic locus, one has a degenerate quasi-linear hyperbolic 
equation (with one vanishing eigenvalue). Recall that a quasi-linear second order equation 
auxx + 2bu xy + cuyy = d, where a,b,c,d depend on x,y,u,u x ,u y , is called elliptic (on the 
solution u) if ac — b 2 > 0, hyperbolic is ac — b 2 < 0. For instance, for a C 2 graph 5 C ffi 3 of the 
type t = u(x, y), (|1.1|) is equivalent to 

(1 + Uy)U XX - 2U X UyU X y + (1 + U 2 )Uyy = , 

for which one has ac—b 2 = l+u 2 +u 2 > 0. On the other hand the condition that S be If-minimal 
becomes, away from the characteristic locus £(<S) = {(x,y,t) G <S | u y — | = , u x + | = 0}, 

(Uy ~ |) U XX ~2(u x + (Uy ~ |) U xy + (u x + |) Uyy = . 

Since in this case ac — b 2 = 0, we conclude that the equation is degenerate hyperbolic. It 
is interesting to observe that since, away from the characteristic locus, we can always locally 
parameterize S in one of the two forms (|1.7|) . (|1.8|) below, then by (|4.19|) below, in terms of the 
function (j>(u, v) the //-minimality of S is expressed by the pde 

<f) uu + 2<f)(j) uv + (j) 2 4> vv = - (f> v ((f)(j) v + 2cf) u ) , 

which again is degenerate hyperbolic. 

The above example t = xy/2 is not isolated since a basic result first proved in |CHMY| . and 
also independently with a different proof in t GPJ , shows in particular that every iZ-minimal entire 
graph over the horizontal plane t = must have non-empty characteristic locus, see Theorem 
15.51 below. These considerations suggest that, in order to have a reasonably behaved horizontal 
Gauss map, in the sub-Riemannian Bernstein problem one should impose the restriction that the 
horizontal bundle HM 1 be transversal to the tangent bundle TS at every point of the surface, 
i.e., S should have empty characteristic locus. This, in turn, immediately imposes a restriction 
on the type of planes which are appropriate in the sub-Riemannian Bernstein problem. Since 
every plane ax + by + ct = 7, for which c / 0, possesses the isolated characteristic point 
(— 26/c, 2a/c, 7/c)), it is clear that we want to confine the attention to the non-characteristic 
vertical planes 

(1.2) P = {(x, y, t) G H 1 \ax + by = 1 } . 

The appropriateness of these planes is also confirmed by the fundamental Rademacher- 
Stepanov type theorem of Pansu |Paj . Specialized to the present setting, the latter states that 
if F : M 1 — ► R is a Lipschitz map with respect to the Carnot-Caratheodory distance associated 
with the subbundle HM 1 , then F is Pansu differentiable at a.e. point g = (x,y,t) G H 1 (w.r.t. 
Lebesgue measure), and the Pansu differential is given by F*(x, y, t) = ax + by, for some a,b G R. 
This result underscores the special role of the vertical planes (|1.2j) in sub-Riemannian geometric 
measure theory. A closely related remarkable fact, discovered in FSSj], is that the blow-up a 
la De Giorgi of a set with locally finite H -perimeter at a point of its reduced boundary is again 
a plane such as (|1.2j) . It is time to introduce a basic definition. 

Definition 1.2. We say that a surface 5ctf of class C 2 is an entire graph if there exists a 
plane P, having equation ax+by+ct = 7, such that for every point go G P the straight line passing 
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through and parallel to the Euclidean normal N e = (a,b,c) to P, L{go) = {go + sN e \ s G M}, 
intersects the surface S in exactly one point. 

The above considerations suggest the natural conjecture that if S C H 1 is an entire //-minimal 
graph, with empty characteristic locus, then S should be a vertical plane Po such as (|1.2jl . Since, 
as we have mentioned, //-minimal is intended in the sense that the horizontal mean curvature 
fi vanishes identically as a continuous function on S, it is worth stressing that, thanks to the 
first variation formula in Theorem 13.21 below, a C 2 surface with empty characteristic locus is 
//-minimal if and only if it is a critical point of the //-perimeter given by ()3.5|) below. However, 
for H 1 the situation is very different than in Euclidean space. In fact, in |GPj the second 
and the fourth named authors discovered the following counterexample to such a plausible sub- 
Riemannian version of the Bernstein problem. The real analytic surface 

(1.3) S = {(x,y,t) £ M 1 | x = ytantanh(i)} 

is an entire //-minimal graph, with empty characteristic locus, over the coordinate (y, i)-plane 
in Mr. This example seems to cast a dim light over the sub-Riemannian Bernstein problem. 

There is however a deeper aspect of the problem which in the classical case is confined to the 
background, but which, due to the diverse nature in the sub-Riemannian setting of the relevant 
area functional, the horizontal perimeter, might be playing an important role. What could be 
happening, in fact, is that //-minimal surfaces such as (|1.3j) are unstable, in the sense that 
they are only critical points, but not local minimizers of the //-perimeter. This phenomenon, 
which goes back to the classical findings of Bernoulli, see e.g. jCaj . has of course no counterpart 
in the Bernstein problem in flat space, since, thanks to the convexity of the area functional 
A(S) = J Q a/1 + \Du\ 2 dx, stability is automatic for a solution to (|1.1|) . see e.g. CM . On the 
other hand, stability had played an important role in the work on complete minimal surfaces 
in 3-manifolds by Fischer-Colbrie and Schoen |FCSj . who generalized Bernstein's theorem and 
proved, in particular, that the only complete stable oriented minimal surfaces in R 3 are the 
planes. This latter result was also independently obtained in |DCPj . 

For the functional which expresses the horizontal perimeter the convexity fails. To see this 
negative phenomenon consider for instance the situation in which S is parameterized by Q1.7JI . 
then it was proved in |ASVj that the //-perimeter of S is expressed by the functional 

P H (S) = V(<f>) = [ Jl + B^) 2 dudv , 
Jn v 

where BAtfi) denotes the nonlinear inviscid Burger operator acting on 4>, see (j4.2U|) , If we set 
£ = 4>ui V = <t>v , then the integrand of the above functional is given by 

F(</>,S,V) = x/1 + (£ + <M) 2 • 

The Hessian of F is given by 

(rj 2 rj <jyq + (£ + 4>r])F 2 

7] 1 (p 

<Pv + (C + H)F 2 <P 4> 2 

and therefore deb V 2 F = — (£ + (j)r]) 2 F~ 5 , which shows that F is not convex. 

These considerations suggest that the above conjecture could be repaired as follows: In M 1 
the vertical planes are the only stable entire H -minimal graphs. As a corollary of our results, 
we will answer affirmatively this amended conjecture in Theorem ll.8l We note that in Theorem 
13.51 below we show that the vertical planes (|1.2|) are stable. An //-minimal surface with empty 
characteristic locus is called stable if the second variation of the //-perimeter is nonnegative for 
every compactly supported deformation, see Definition 13.31 below. The role of stability in the 
sub-Riemannian Bernstein problem has been recently highlighted in |DGN2j . where the first 
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three named authors have proved the instability of the //-minimal entire graphs x = y(at + f3), 
with a > 0, (3 G M. This result also clarified an incorrect belief by several experts in the field, 
namely that such surfaces should constitute a counterexample to the above formulated amended 
form of the Bernstein conjecture. 

We are ready to give a summary of our results. In H 1 we single out a large class of //-minimal 
surfaces, which we call graphical strips, see Definition 11.31 below, and which, after possibly a 
left-translation and rotation about the i-axis, can be represented in one of the two forms (|1.4|) . 
or (|1.5|) . If for the function G in these definitions we have G' > on some sub-interval, we 
call the relative surface a strict graphical strip. In Theorem 11.51 we show that graphical strips 
are //-minimal, and have empty characteristic locus. Our first main result shows that every 
strict graphical strip is unstable, in the sense that there exist local deformations of the surface 
which strictly increase the horizontal perimeter, see Theorem 11.61 Our second main result, 
Theorem 11.71 shows that, modulo left-translations and rotations about the group center, every 
//-minimal entire graph in H , with empty characteristic locus, and which is not itself a vertical 
plane, contains a strict graphical strip. Combining this result with Theorem II .61 we prove that 
the only stable //-minimal entire graphs in H 1 , with empty characteristic locus, are the vertical 
planes, see Theorem 11.81 

To state our main theorems we begin with a definition which plays a central role in our work. 

Definition 1.3. We say that a C 2 surface 5ctf is a graphical strip if there exist an interval 
J C R, and G G C 2 (/) ; with G' > on I, such that, after possibly a left-translation and a 
rotation about the t-axis, then either 

(1.4) S = {Or, y, t) G M 1 | (y, t) G R x /, x = yG(t)} , 
or 

(1.5) S = {(x,y,t) G H 1 | (x,t) G R x I,y = -xG(t)} . 

If there exists J C I such that G' > on J, then we call S a strict graphical strip. 

Remark 1.4. We stress the importance of the assumed strict positivity of G' in the definition 
of strict graphical strip, as opposed to the weaker requirement G' > 0. This positivity will play a 
crucial role in the proof of Theorem M.bX We also mention explicitly that while a vertical plane 
such as (|1.2|) is a graphical strip, it is not a strict graphical strip. If for instance o ^ 0, then we 
can re-write (|1.2|) as x = ay + (3, with a = —b/a, and (3 = "f/a. Assuming (3 = 0, which can be 
always achieved by a left-translation (see (|1.6|) below), we would have G(t) = a, and therefore 
G' = 0, against the assumption in Definition M.iA 

We now state a first theorem which, besides having an interest in its own right, also serves to 
motivate our main results. 

Theorem 1.5. Let 5ci' be a graphical strip, then S is H -minimal and it has empty char- 
acteristic locus. When I = R, then every surface such as (|1.4|) or (|1.5|) is a global intrinsic 
H -minimal graph. 

We stress that in the Heisenberg group the left-translations (|2.2P are affine transformations, 
thereby they preserve planes and lines. For instance, if P denotes the plane ax + by + ct = 7, 
then denoting by P' = go o P, where go = (xq, yo,to), one easily sees that P' is given by 

(1.6) (a + x + (b - V + ct = 7 + ax + by + ct . 

Notice that a vertical plane (c = 0) is mapped into a vertical plane by a left-translation. More 
in general, the left-translations preserve the property of a surface of having empty characteristic 
locus. Furthermore, they preserve the //-mean curvature, and therefore the //-minimality, the 
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ff-perimeter, and the property of a surface of being stable. We also notice that rotations about 
the i-axis (the group center), also have the same properties. 

The notion of intrinsic graph in the second part of Theorem ll.5l is that introduced in FSS3 , 
but see also [FSS2J . The proof of Theorem ED shows that if S is of type (|1,4|) with I = R, then it 
is a global Xi-graph, whereas if it is of type Q1.5JI , then S is a global A^-graph. We recall that S is 
said an intrinsic Xi-graph if there exist an open set ft C R 2 v , and a C 2 function : ft — > R, such 
that on ft we can parameterize S as follows (x,y,t) = (Q,u,v)o(f)(u,v)ei = (0, u, v)o(cj)(u, v), 0, 0). 
This means that 

(1.7) S = {(x,y,t) G H 1 | (u,v) G ft, (x,y,t) = (j)(u,v),u,v - . 

When we can take ft — R 2 ut ^, then S is called a global A^-graph. Similarly, if the points of 
5 can be described by (x, y, t) = (u, 0, v) o <j)(u, v)&2 = (i*, 0, v) o (0, 0(u, u), 0), i.e., if 

(1.8) 5 = {(x,y,t) G M 1 | (u,v) G n,(x,y,t) = (u, cf)(u, v) , v + ~<f>(u, v)^j} , 

then 5 is said an intrinsic A2-graph (global, if ft = R?v). Clearly, the vertical planes Q1-2JI are 
global intrinsic graphs. If, for instance, then Pq can be parameterized as in (jl.7|) . with 

0(it, f ) = u H — . 

a a 

Before proceeding, we pause to give some examples which illustrate the situation of Theorem 
PI 

Example 1: The choice G(t) = tantanh(t) makes (jl.3|) a special case of Theorem 11.51 We 
stress that in this example G'(t) > for every t G R, and therefore the surface S is a strict 
graphical strip with I = R. According to Theorem 11.51 we conclude that S is also a C u global 
intrinsic Ai-graph. 

Example 2: The class of strict graphical strips is not contained in that of global intrinsic 
graphs. Consider, for instance, the function G(t) = cot(— t + ^), with — ^ < t < |. We note 
that G'(t) > 0, and therefore the corresponding surface in (|1.4j) . 

X = y GOt(-t + -) , 

is a strict graphical strip, with / = (— f , f ). This surface is the helicoid 

x = r cos 9 , y = r sin 9 , t = —9 + — , < r < oo , < # < 7r . 

2 

If we set fl = 1 x I, then the map $(y, i) = (y,t + ^-G(i)) is not a diffeomorphism of D onto 
the whole (u, w)-plane. However, the arguments in the proof of Theorem 11.51 show that it is a 
diffeomorphism onto the connected open subset SJcK^ defined by ft = R 2 \ (L+ U L~), where 
L+ = {(0,-y) G R 2 | v > f }, L~ = {(0,v) G R 2 | v < -~ }. As a consequence, the helicoid is not 
a global intrinsic graph, although it is a C w intrinsic Ai-graph on the domain ft. If we denote 
by ^(u,v) = (^i(u,v), i S>2{u,v)) = < I )_1 (u, v), then the function 4>(u,v) in (|1.7|) is given by 

= uG(^ 2 (u,v)), (u,v)eU. 

Example 3: The choice G(t) = at + 3, with a > 0, (3 G R, gives the strict graphical strips 
rr = y(at + /3) studied in |DCN2j . where it was proved that these surfaces are unstable. We 
note that such surfaces are C u global intrinsic fZ-minimal graphs . We also observe that in this 
example it is possible to compute explicitly the function 0(u, v) in (jl.7|) which describes S as a 
global Ai-graph. One finds 

2u(av + 3) 
2 + au z 
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Example 4: The surface described by 

S = {(x,y,t) ei 1 | (y,t) £lx (0,oo),x = yt 2 } , 

is a strict graphical strip with / = (0, oo), but like the surface in example 2, it is not a global 
intrinsic graph. 

We are now ready to state the first main result of this paper. In what follows we indicate with 
u H = N H /\N H \ the horizontal Gauss map of S, see section |2J and by Vfj{S\X) the second 
variation of the ff-perimeter with respect to a deformation of S in the direction of the vector field 
X, see Definitions 13.11 and 13.31 below. An ii-minimal surface S is called stable if V/^(5; X) > 
for every compactly supported X = aX\ + 6X2 + kT. Otherwise, it is called unstable. We 
note that, since thanks to Theorem II . 51 every graphical strip has empty characteristic locus, the 
horizontal Gauss map u H of such a surface is globally defined. 

Theorem 1.6. Let S be a strict graphical strip, then S is unstable. In fact, there exists a 
continuum of h G Cq(S), for which V^j(S; hu H ) < 0. 

As a consequence of Theorem 11.61 the H- minimal surfaces corresponding to Examples 1, 2, 3 
and 4, are all unstable, i.e., they are not local minimizers of the ff-perimeter. We emphasize that 
the class of strict graphical strips is very wide. For instance, as we show in Theorem 1 1 . 71 below . 
every if -minimal entire graph in H , with empty characteristic locus, and which is not itself a 
vertical plane, contains a strict graphical strip. The main ingredients in the proof of Theorem ll.6l 
are the second variation formulas for the if-perimeter, see Theorem 13.41 below, and the explicit 
construction of deformations of the surface along which the ff-perimeter decreases strictly. This 
part is delicate and it has been influenced by the recent paper |DGN2j . In connection with 
Theorem 11.61 we mention that, after the present work was completed, we have received the 
interesting paper BSV] in which the authors, using the construction in |DGN2j . in combination 
with other tools in part also independently developed in |GSj . establish the instability of global 
intrinsic graphs, thus answering affirmatively the above formulated Bernstein type conjecture in 
this setting. As we have seen, Theorem 11.61 includes surfaces, such as for instance the helicoid 
in example 2, or that in example 4, which are not global intrinsic graphs. 

Here is our second main result. 

Theorem 1.7. Let 5 Cl 1 be an H -minimal entire graph, with empty characteristic locus, and 
that is not itself a vertical plane such as (|1.2|) . then there exists a strict graphical strip Sq C S. 

We mention explicitly that the above statement should be interpreted in the sense that, 
after possibly composing with a suitable rotation about the t-axis and a left-translation, the 
transformed surface contains a portion of the type (|1.4[) , or (|1.5|) . The proof of Theorem 11.71 is 
based on some of the main results in |GPj . For clarity of exposition we present in Section |S] a 
detailed account of the main reduction steps. We mention that, alternatively, one could use the 
results independently obtained in CHM^ and [CH . 

Finally, by combining Theorems 11.61 and 11.71 we answer affirmatively the above formulated 
Bernstein conjecture. 

Theorem 1.8 (of Bernstein type). In H 1 the only stable H-minimal entire graphs, with 
empty characteristic locus, are the vertical planes ()1.2|) . 

Concerning the higher-dimensional case of Theorem II .81 we mention that, using the construc- 
tion in BDG , we obtain the following negative result. 

Theorem 1.9. In HP, with n > 5, there exist C w stable H-minimal graphs, with empty char- 
acteristic locus, which are not vertical hyperplanes. 
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What happens when n = 2,3,4 is, presently, terra incognita. We will now briefly describe 
the organization of the paper. In section |2] we collect some basic facts about the Heisenberg 
group, and introduce the main geometric set-up. In section |3] we collect some results from sub- 
Riemannian geometric measure theory, specifically, the first and second variation formulas for 
the horizontal perimeter. Sections 0] and |S] are the central parts of the paper. After proving 
Theorem 11.51 the remainder of section |1] is devoted to proving Theorem 11.61 In section |5] wc 
prove Theorems 11.71 and 11.81 Finally, in section we prove Theorem 11.91 

Acknowledgment: This paper was presented by the second named author in the UCI-UCSD 
joint Differential Geometry Seminar at the University of California, San Diego, La Jolla, in 
February 2006. He would like to thank Lei Ni for stimulating discussions and for his gracious 
hospitality during his visit, and Salah Baouendi, Dima Khavinson, Peter Li and Linda Rothschild 
for their interest in the problem. 



2. Preliminaries 



In this section we collect some definitions and known results which will be needed in the 
paper. We recall that the Heisenberg group HP is the graded, nilpotent Lie group of step r = 2 
whose underlying manifold is C n xl = M 2n+1 , with non-Abelian left-translation 

L{z,t){z' ,t') = (z,t)o(z',t') = (z + z',t + t' -hmiz-z 7 ) 

and non-isotropic dilations 

(2.1) S x (z,t) = (Xz,X 2 t) , A > . 

These dilations provide a natural scaling associated with the grading of the Heisenberg algebra 
t)n = Vl © V%, where V\ = C n x {0}, V2 = {0} x R. The homogeneous dimension associated with 
()2.1|) is Q = 2n + 2. We recall that identifying f) n with M 2n+1 , by identifying z = x + iy G CP 
with (x,y) G E? n , we have for the bracket of £ = (x,y,t), £' = (x',y',t') G f) n 

= (OAx-y'-x'-y) . 

Here, and throughout the paper, we will use v ■ w to denote the standard Euclidean inner 
product of two vectors v and w in W 1 . It is then clear that [Vj.,Vi] = V21 an d that V2 is the 
group center. Via the Caley map, H n can be identified with the boundary of the Siegel upper 
half-space U n = {z G C n+1 | Im z n+ \ > 2 2~^j=i l z j| 2 }) see Ch.12 in In the real coordinates 
g = (x, y, t) G M 2n+1 the non-Abelian group law of HP is given by 

(2.2) gog' = (x, y, t) o (x', y', t') = {x + x', y + y',t + 1' + -(x ■ y' - x' ■ y)) . 

Let (Lg)* be the differential of the left-translation L g (g') = g o g' . A simple computation 
shows that 

( d \ def d Xi d 

(I) ^ T = I 




s 



D. DANIELLI, N. GAROFALO, D. M. NHIEU, AND S. D. PAULS 



We note that the only non-trivial commutator is 

[Xi,X n+j ] = 5ij T , i,j = l,...,n , 

therefore the vector fields {X\, ...,X 2n } generate the Lie algebra h n . 

Henceforth, HP will be endowed with a left-invariant inner product < -, • >, with respect to 
which {Xi, X2 n , T} constitute an orthonormal basis. With the exception of the Euclidean 
inner product, which, as we have said above, we denote v-w, no other inner product will be used 
in this paper, so when we write < ■ > there will be no danger of confusion. The horizontal 
bundle is HM n = L> gm nH g M n , where 

H g M n = span{X 1 (g),...,X 2n (g)} . 

We denote by VjF the Levi-Civita connection with respect to < •,• >. Projecting such 
connection onto the horizontal subbundle HW 1 C TEP, we obtain a connection Vyl" on HW 1 , 
which we call the horizontal Levi-Civita connection. This idea goes back to that of E. Cartan's 
non-holonomic connection, see |U]. For any X £ r(THP), Y G T(HW n ) we let 

2n 

(2.4) V%Y = Y,< V * Y ' X i > X i > 

i=l 

and one can easily verify that V^l" is metric preserving and torsion free, in the sense that if we 
define the horizontal torsion of 5 as 

t h (x,y) = vfy - V§X - [X,Y] H , 

where [X,Y] H = J2f=i < [X,Y],Xi > X h then T H (X,Y) = 0. If / € C 1 ^"), we let 

2n 

v H f = ^<v/,x 4 >x 4 , 

1=1 

where we have denoted by V/ the Riemannian gradient of /. 

Given an oriented hypersurface S C HP, we denote by N the Riemannian non-unit normal 
to S. Throughout the paper, we will indicate with 

E(5) = {g G S | T g S = HgW 1 } , 

characteristic locus of S. Notice that g £ S(«S) is equivalent to having < N,Xi >= 0, i = 
1, 2n, at g. We recall that it was proved in |B] that i5/^ -1 (£(<S)) = 0, where H s indicates the 
s-dimensional Hausdorff measure constructed with the Carnot-Caratheodory distance associated 
with the subbundle HM n . If S is of class C 2 , then we define the non-unit horizontal normal of 
S by 

2n 

N H = ^2<N,X t >X t . 

i=i 

It is clear that at a given g G S one has N H ^ if and only if g g" X(<S). If g £(<S), then 
the horizontal tangent space to S in g is defined by 

(2.5) HTgS = {«£ H g n n \<v,N H >= 0} . 

It is easy to recognize that HT g S = T g S n HgW 1 . The horizontal tangent bundle of S is 

HTS = U T^S. At every non-characteristic point of S we define the horizontal Gauss map by 

ges 

letting 
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Since 

H g U n = HT g S span{u^} , 
we have dim{HT g S) = 2n — 1. For instance, in HI 1 we simply have HTS = span{ei}, where 
d = {v H ) L = <u H ,X 2 > X 1 - < u H ,X 1 > X 2 . 

Definition 2.1. Let S C HP be a C k hyper surf ace, k > 2, with £(<S) = 0, then we define 
the horizontal connection on S as follows. LetX7 H denote the horizontal Levi-Civita connection 
introduced above. For every X, Y G C (<S; HTS) we let 

V% S Y = Vf Y - < Vf Y, v H > u H , 

where X,Y £ C 1 (H n ; i?H n ) are suc/i t/iat X = X,Y = Y onS. 

One can check that Definition 12, II is well-posed, i.e., it is independent of the extensions X,Y 
of the vector fields X, Y. For every X,Y G C («S; HTS) one has 

(2.6) V^' 5 F - Vy' S X = [X,Y] H - < [X,Y] H ,u H > u H , 

in other words V^'^y — Vy' 5 X equals the projection of [X, Y] H onto HTS. 

It is clear from (|2.6j) that the horizontal connection V^' 5 on 5 is not necessarily torsion 
free. This depends on the fact that it is not true in general that, if X, Y S C 1 (S; HTS), then 
[X,Y) H G C^S-^TS). However, since in the first Heisenberg group H this is trivially true, in 
this setting V H,S is torsion free, and therefore it has the properties of a Levi-Civita connection. 

Given a function / G C 1 (S) we will denote 

(2.7) V H ' S f = V H J - < V H J,v H > v H , 
where / G C (EP) denotes any extension of /. Henceforth, we will let 

vf' 5 / = <v H ' s f,Xi> = x~j - <v ff //>< I /V.> • 



Definition 2.2. Let S C HP 6e a C fc hypersurface, k > 2, with S(«S) = 0, t/ien /or every 
X, Y G C 1 ^; HTS) we define a tensor field of type (0, 2) on S, as follows 

(2.8) LL H ' S (X,Y) = < X7%Y,v H > u H . 

We call LL H,S {-, ■) the horizontal second fundamental form of S. We also define A H ' S : HTS — > 
HTS by letting for every g G S and u, v G HT g S 

(2.9) <A H ' S u,v>= - < IL H ' S (u,v),u H > = - <V%Y,v H >, 

where X, Y G C 1 (5 , HTS) are such that X g = u, Y g = v. We call the linear map A H,S : 
HT g S — > HTgS the horizontal shape operator If e.\, e2 n -i denotes a local orthonormal frame 
for HTS, then the matrix of the horizontal shape operator with respect to the basis e±, e2 n -i 
is given by the (2n — 1) x (2n — 1) matrix — [ < \7^ej,u > j^—j 2n-i' 

Definitions 12.11 and 12.21 are taken from |DGJNlj . A different notion of the second fundamental 
form has been explored by the last named author and R. Hladky [HP] using a generalization 
of the Webster- Tanaka connection on a wide class of sub-Riemannian manifolds. This second 
fundamental form and the (un-symmetrized) operator A H,S are used to analyze the minimal 
and constant mean curvature surfaces in this setting. We emphasize that, when restricted to 
the case of the Carnot groups, these two formulations are equivalent. 
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We call horizontal principal curvatures the real eigenvalues k%, n 2 n-i of the symmetrized 
operator Asym = \{A H > S + {A H ' S Y). The horizontal mean curvature of S is defined as follows 

(2.10) H = Ki + ... + K 2n -i ■ 

When the hypersurface S has non empty characteristic locus, then at every go G £(<S) we 
define 

H(go) = lim H(g) , 

provided that such limit exists, finite or infinite. We do not define the H-mean curvature at 
those points go G £ at which the above limit does not exist. 

Definition 2.3. A C 2 surface S C H 1 is called H -minimal if Ti = as a continuous function 
on S. 

We will need the following result, which will prove useful for computing the H-mean curvature, 
see Proposition 9.8 in |DGNlj . 

Proposition 2.4. The H-mean curvature in definition (|2.1Uj) coincides with the function defined 
by the equation 

2n 
i=l 

Given a vector field X G C 1 (H n ; FEI n ), we denote by 

dro^JST = E X, < X, Xi > , 

i=l 

the horizontal divergence of X. 



3. First and second variation of the //-perimeter 



In this section we introduce the relevant notions of stationary and stable surface which enter 
in the statement of Theorem 11.81 and we recall the first and second variation formulas from 
jDGJNlj and jDGN2j which will be used in its proof. 

Given an oriented C 2 surface Sci 1 , with Riemannian (non-unit) normal N, we introduce 
the quantities 



(3.1) p=<N,X 1 >, q=<N,X 2 >, cj=<iV,T>, W = yV + 
and, at every point where W ^ 0, we set 

(3 - 2) p= w> q= w> u = W 

Notice that 

(3.3) N H = pXi + qX 2 , u H = pX!+qX 2 , < N H ,N> = W 2 . 

/,From ()3.3() we easily recognize that 

W 



(3.4) cos(N H ZN) 



\N\ 
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In the classical theory of minimal surfaces, the concept of area or perimeter occupies a central 
position, see DGl , DG2j, [H], |MM| . |CMj . In sub-Riemannian geometry there exists an 
appropriate variational notion of perimeter. Given an open set W C H 1 we denote J~(U) = {C £ 
C^U-^M 1 ) | ||Clk- (w) < 1}. A function / G L X {U) is said to belong to BV H {U) (the space of 
functions with finite horizontal bounded variation), if 



V ar H{f'M) = sup / / div H Q dg < oo . 
CeF(U) Ju 



This space becomes a Banach space with the norm 1 1/| (T2) = ll/llz, 1 ^) + Varn{u; ft). 
Given a measurable set £ C Mr, the H-perimeter of £ with respect to the open set W C i 1 is 
defined as follows, see for instance |GDG| . and |GJN| . 

P H {£-M) = Var H ( X£ -M) . 

When £ is a C 1 domain, one can recognize that 

(3.5) Ph(£-M) = [ cos(N H ZN) da , 

Jdsnu 

where da indicates the standard surface measure on d£. We will denote by dan the .ff-perimeter 
measure concentrated on S = d£. According to (|3,4j) . ()3.5|) . we have for any Borel subset E C S 
such that Ph{E) < oo, 

f W 

(3.6) a H {E) = r—da. 



-E\N\ 

Two important properties of the .H-perimeter are its invariance with respect to the dilations 
(|2.1|) and the left-translations (|2.2|) . The former, is expressed by the equation 

a H (5 x (S)) = A^- 1 a H (S) . 

In keeping up with the notation of [D GN2j it will be convenient to indicate with YC, and 
the respective actions of the vector fields u H and {u 11 ) 1 - on a function £ G C 1 (S), thus 

(3.7) Y( d = f p XxC + q X 2 ( , Z( d = f q Xx( - p X 2 ( . 

The frame {Z,Y,T} is orthonormal. It is worth observing that, since the metric tensor {gij} 
with respect to the inner product < •, • > has the property det{gij} = 1, then the (Riemannian) 
divergence in H 1 of these vector fields is given by 

(3.8) div Y = Xip + X 2 q = H , div Z = X x q - X 2 p , 

where the first equality is justified by Proposition 12.41 and by the fact that \v H \ = 1. Using 
Cramer's rule one easily obtains from (j3,7l) 

(3.9) ZiC = q Z( + p YC, X 2 ( = q Y( - p ZQ . 
One also has 

(3.10) Vf ' 5 C = 1 Z(, Vf ' S ( = -PZ(, 
so that 

(3.11) |V^' 5 C| 2 = (Z() 2 ■ 
We notice that 

(3.12) qZp - pZq = H . 

This can be easily recognized using the first equation in (J3.8|) . and (|3.9|) . as follows 
7i = X\p + X 2 q = qZp — pZq + pYp + qYq = qZp — pZq , 
where we have used the fact that = ^Y(p 2 + q 2 ) = pYp + qYq. 
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Definition 3.1. Let 5 c! 1 be an oriented C 2 surface, with E(<S) = 0. Consider the family of 
vector fields X = aX\ + 6X2 + kT, with a,b,k G Cq (S), and the family of surfaces S x , where 
for small A G R we have let 

(3.13) S x = J\(S) = S + XX . 

We define the first variation of the H -perimeter with respect to the deformation (|3.13|) as 



A=0 



We say that S is stationary if Vf(S; X) = 0, for every X . 

Classical minimal surfaces are stationary points of the perimeter (the area functional for 
graphs). It is natural to ask what is the connection between the notion of H- minimal surface 
and that of i7-perimeter. To answer this question we recall the following results from |DGNlj . 

Theorem 3.2. Let 5 c! 1 be an oriented C 2 surface, with £(<S) = 0, then 

(3-14) Vf{S-X) = In C ° S /^ r \ \X\ dan . 



Is cos(u H ZN) 
Ln particular, S is stationary if and only if it is H -minimal. 

Versions of Theorem 13 . 21 have also been obtained independently by other people. An approach 
based on motion by H-mean curvature can be found in |BCj . When X = au H + kT, then a proof 
based on CR-geometry can be found in |CHMY| . and |RR2j . Recently, a general first variation 
formula for a wide class of sub-Riemannian spaces has been found in |HPj . 



Definition 3.3. Given an oriented C 2 surface S C M , with E(<S) = 0, we define the second 
variation of the H-perimeter with respect to the deformation (|3,13|) as 

We say that S is stable, if it is stationary (i.e., H-minimal), and if 

Vu(S;X) > , for every X. 

Lf there exists X ^ such that Vj I I (S; X) < 0, then we say that S is unstable. 

The following second variation formula from |D(tN1| . see also Theorem 3.3 in DGN2 , will 
play a crucial role in the proof of Theorem 11.61 

Theorem 3.4. Let Sci 1 be a C 2 oriented surface, with empty characteristic locus, then the 
second variation of the H-perimeter with respect to the deformation (|3.13j) . with X = hv H , 
h G Cq(5), is given by 

(3.15) VfiiS; hv 11 ) = J I {Zh) 2 + h 2 [2(pTq - qTp) + 2u){qYp ~ Wt) + } da H . 

Lf instead we choose X = aX±, a G Cq(S), in ()3.13|) . then the corresponding second variation is 
given by 

(3.16) Vu{S;aXx) = J \f{Zaf + p 2 ZJ 2 a 2 

+ UJZ{a 2 ) -pq (T(a 2 ) - u3Y(a 2 )) \ da H . 
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Theorem 13.41 ia special case of a general second variation formula found in jDGJNlj . see also 
Theorem 3.3 in DGN2 . Using such general result, in combination with some integration by 
parts formulas from DGNT], we can prove the following theorem. 



Theorem 3.5. Every vertical plane such as (|1.2j) is stable. 

Proof. Since the notion of stability is invariant under left-translations, and rotations about the 
t-axis, we can assume without restriction the P$ = S is the plane x = 0. Since for this surface we 
havep = 1,5 = u = 0, the formula (3.3) in Theorem 3.3 in |DGN2j gives for X = aXi+bX2+kT, 

V^j{S;X) = j {{Zaf + 2{TbZk - TkZb) + T(ab)} da H . 

Since a, b, c are compactly supported in 5, Lemma 3.7 in DGN2 gives 

J T(ab)da H = . 

We also have 

j TbZk da H = j T(bZk) da H - j bT(Zk) da H 

= - f bZ(Tk) da H + / b[Z,T]kda H 
Js Js 

We now using the following commutator formula from |DGNlj 

[Z,T] = (qTp — pTq) Y , 

valid on any non-characteristic surface. In the present case, such formula gives [Z, T] = 0, and 
we thus conclude 

j TbZk da H = - j bZ(Tk) da H = - j Z(bTk) da H + J TkZb da H . 

Since Lemma 3.6 in DGN2 gives for every £ S Cg(<S), 

/ Z( dan = - / (w dan = , 
Js Js 

we finally obtain 

V%{S;X) = j ' {Zaf da n > 0. 
This proves the stability of S. 

□ 



4. Instability of strict graphical strips 



After these preparations we turn to the core of the proof of Theorem 11.61 To put the subse- 
quent discussion on a solid ground, we begin with proving Theorem 11.51 

Proof of Theorem 1 1.51 We provide the proof only for the class of surfaces in (|1.4jl . leaving 
it to the interested reader to develop the completely analogous details for the second class. It 
is obvious from the definition (|1.4|) that S is a C 2 graph over the open subset R x J of the 
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(y, i)-plane. We next observe that S has empty characteristic locus. We can use the global 
defining function 

(4.1) <Kx >y> t) = x-yG{t) , 

and assume that S is oriented in such a way that N = V(p = (Xi(f>)Xi + (X 2 (j))X 2 + (T(f>)T. 
Recalling (|3.1|) . we find 

2 

(4.2) p = X 1( f> = 1 + V -G'{t) , q = X 2 = -G(t) - ^-G'(t) , u =Tcf> = -yG'{t) . 

Since p > 1 > 0, we see from (|4.2jl that S(5) = 0. In order to prove the .ff-minimality of S, 
we use (|3.8|) . which gives 

H = X{p + X 2 q . 

^From now on, to simplify the notation, we will omit the variable t in all expressions involving 
G(t),G'(t),G"(t). The second equation in (|4.2|) becomes on S 

(4.3) q = - G ( 1 + ^-G' 



We thus find on S 

/ 2 \ 2 

(4.4) W 2 = p 2 +q 2 = (1 + G 2 ) (l + V —G' 

Since they will be useful in the proof of Lemma 14.11 in what follows we compute several 
quantities, even if they are not strictly necessary for the calculation of TC. From ()4.2|) we find 

(4.5) X 1P = -t-G" , X 2 p = yG' + ^G" , 

(4.6) X iq = ^-G" , X 2 q = - X G'-^G" . 
/.From (IQl) . fOjl . (jlH) we find on 5 

(4.7) X 2 g = - 2/G (V + ^-GG" 
and 

(4.8) X lW = + = -t G "{l + G 2 Y . 

(4.9) x 2 iy = P^ + gx 29 = ^ (1 + g2) i r , + y^QQH 

We now compute 

(410) = -^-^-W^ + lF 

Using fOjl . (jUSJ), (jHZJ), (HIHI) and (g^J), we find 

gig Xiiy _ X29_ 

VF P W 2 ' W 9 VF 2 

Inserting the latter two equations in (|4.1U|) we conclude that 5 is _ff-minimal. To complete 
the proof of the theorem we are left with showing that, when I = M, the surface S in (|1.4|) is a 
global intrinsic Xi-graph according to [FSS3 . To prove this, we want to show that there exist 
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curvilinear coordinates (u, v) £R 2 , and cp G C 2 (R 2 v ), such that S can be globally parameterized 
by 

(4.11) 9(u,v) = (j)(u,v),u,v - ^(j)(u,v)j . 

We thus see that we must have 



(u,v) = x, u = y, v--4>(u,v) = t. 



These equations give 



2 

u y y 

u = y , v = t + -<p(u, v) = t + -x = t + -G(t) . 

We want to show next that the map $ : R 2 , t — > R 2 v given by 

Hy,t) = (y,t + y ^G{t) 
defines a global diffeomorphism onto. Now, its Jacobian is given by 

(4.12) det 1 + = 1 + + 0, for every (y,t)GR 2 . 
Furthermore, $ is globally one-to-one. Assume in fact that ti) = <&(y 2 , ^2), then we have 

2 2 

(4.13) 2/1 = 2/2, t 1 + ^-G(t 1 ) = t 2 + ^-G(t 2 ) . 

Now, let a = y± = y 2 , then either a = 0, in which case (|4.13|) gives t\ = t 2 , or a / 0. In 
this second case, we look at the function f(t) = t + (a 2 /2)G(t), and we see that / is strictly 
increasing over R. Therefore, (|4,13|) forces again the conclusion t± = t 2 . It is also easy to see 
that $ is onto. Thanks to the assumption G' > one has in fact for every y G R 

y 2 

lim t + — Git) = ± 00 . 
t— »±oo 2 

Therefore, given (u,w) G R 2 , if we choose y = u, then we can always find t G R such 
that t + ^-G'(t) = v. In conclusion, is globally invertible on R 2 . Denote by ^(u, v) = 
(^i(u,v),^/ 2 (u,v)) the inverse of Clearly, y(u,v) = u. But then the function 

(4.14) 4>{u,v) = uG(V 2 (u,v)) , 

defines S as a global intrinsic Xi-graph. We note that, using ()4.12l) and the inverse function 
theorem, we obtain for the Jacobian matrix of \& 

f 1 \ 

(4.15) Jy(u,v) = uG 1 , 

where for brevity we have written G instead of G(^ 2 (u, v)), and similarly for G' . 

In closing, for the benefit of the reader, we provide a second derivation of the ff-minimality 
of the surface (|1.4I) based on the fact that it is locally an intrinsic Xi-graph as in ()4.11j) . with 
4>{u,v) given by ()4.14j) . We stress that the following computations only use the fact that 5 be 
locally defined as in (|4.11|) in the neighborhood of any fixed point, for some C 2 function 4>(u, v). 
We will use the following formula, found in |GSj . [J3SV , for the .ff-mean curvature of an intrinsic 
graph in H 1 
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where for a function / G C 1 (M) 

(4.17) B^f) = f u + <t>f v 
denotes the linear transport operator. One can easily verify that 

(4.1 8 ) n = - B * {B * m , , 

(i + e^) 2 ) 5 

and therefore the condition that S be .ff-minimal becomes 

(4.19) MM<t>)) = > <t> G c2 ( r2 ) , 

where now 

(4.20) B^) = + , 

denotes the nonlinear inviscid Burger operator. Using l|4.14fl . <|4.15|1 . we compute 

v 9* 2 , / ttG \ G(l-^-G' 



G + uG'-=-=- = G + uG' 



du y l + ^G" / 1 + f G' 

uG 



dv i + 



^From the last two formulas we find 

BJ6) = G. 



This gives 

B+{Bm = MG) = G u + (t) G v = G'^ + uGG'^ = — ^ + ^ 



au a« i + ^g' 1 i + ^G' 

which, according to Q4.19|) . proves the H- minimality of S. 

□ 

We now turn to the proof of Theorem ll.61 Since we will want to compute the second variation 
of a graphical strip such as (|1.4j) with respect to deformations along the horizontal normal v , 
we will need to use formula Q3.15[) in Theorem 13 .41 As a first step, we will compute the quantities 
which appear as the coefficient of h 2 in the integral in the right-hand side of (|3.15|) . This is the 
content of the next lemma. 



Lemma 4.1. Let S be the H-minimal surface given by (|1.4[) . then one has 

2G'(t) 

(4.21) 2{pTq - qTp) + 2uJ(qYp ~ pYq) + uJ 2 = - . 

Proof. As in the proof of Theorem ll.51 we use the global defining function (|4.1|1 . and we obtain 
(jOJ). Using (|3~7|) and (|4~5j) . (|4TH|). we obtain on S 

(4-22) 1> = ±{ p X lP + qX 2 p} = - ^— — r \ ^jG"{l + G 2 ) + GG'j , 

w (1 + G 2 )a I 4 J 

(4-23) = ^{pXag + ffXag} = -^[^"(l + G^ + GG'} . 

Combining (|4~^> . (l4~2T?|) we find 



(4.24) 



= ^{pYp + qYq} = - y |^G"(1 + G 2 ) + GG'j 
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Combining (|4.22|) . (|4.23|) and ()4.24j) . two small miracles happen, namely 

WYp-pYW v _ WYq-qYW 

(4.25) Yp = ^ = , Yq = ^ = . 

We now turn to the computation of the derivatives along the characteristic direction T. Differ- 
entiating (|4.2|) we obtain on S 

2 / 2 

(4.26) Tp = y~G" , Tq = - (g' + ^-GG" 
/,From Q4.26[) we find 

(4.27) TW = ±-{pTp + qTq} = 1 I G G + ^-G" (1 + G 2 ) 

vv (1 + G Z )2 (. A 



Using (|4~2^)l and (|4~2"7)) we obtain 



(4-28) Tp= - , Tq 



W(l + G 2 ) ' * W(l + G 2 ) 

^From (J4~2"j) and (jl~2"%|) we conclude that 

Ql 

(4.29) pTq - qTp = r . 

W(l + G 2 )2 

Finally, combining (|4~2T)|) with (gjZnj) and (jOj) , we obtain 

2G'(t) 

2{pTq - qTp) + 2uJ(qYp ~ Wl) + cJ 2 = - 

which proves (|4.21j) . 



□ 



^From Theorem 13.41 and Lemma 14. 11 we obtain the following corollary. 
Corollary 4.2. Let S be an H -minimal surface given as in (|1.4|) . For any h G Cq(S), one has 

(4.30) Vfj(S;hu H ) = J s \V H > S h\ 2 da H - 2 J oV„ . 
For any a G Cq(S), one has 

r (l + £G(t)Y , 2 

(4.31) V{ I I (S;aX 1 ) = / A ^|V H ' 5 a| 2 ^ - 2 / — | ^ 9 , aV g . 



W 2 1 " 7 5 T^ 2 (1 + G(t) 2 

To proceed further we next project onto the (y,t) plane the formulas (|4.3U|) . ()4.31|> by means 
of the C 2 parametrization 9 : K x / — » 1R 3 of the surface 5 given by 6(y, t) = (yG(t),y, t). 

Lemma 4.3. Let S be the H -minimal surface given by (|1.4[) . For any h G Cq(«S), one /ias 

(l + ^G'(t)) u 2 



dydt 
u 2 G'{t) 



xi (l + ^G'(t)) (l + G(t) 2 )V2 



dydt , 
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where we have set u = h o 9 £ Cq(R x /) . For any a £ Cq(S), one has 



(!.:«) VhiS-.aXn - / i \ 1 + G{t)2) { /2 dydt 

u 2 G'{t) 



o (l + ^G'(i)) (l + G(t) 2 ) 3 /2 



2 

2/ 



where this time we have let u = a o £ Cg(R x /). 



Proof. In order to prove (|4.32|) we make some reductions. Keeping in mind (|3,6|) . from 14.4f) 
we obtain 

(4.34) / K > da H = / 5 r-^ dydt . 

■>s ^ ./rxj h + 2f G'(t)J (1 + G(t) 2 ) 1 / 2 

In order to express the first integral in the right-hand side of Q4.3UJI as an integral on R x I, 
we compute \V H ' S h\ 2 . We have from (g£7J), (|4~2^1 and ijO)) 

(4.35) (V^/il 2 = (Zh) 2 = (qX 1 h-pX 2 h) 2 

{G{t)X 1 h + X 2 h) 2 
l + G(t) 2 

Now, the chain rule gives u y = G(t)h x + h y , and therefore we see that we have on S 

G(t)X 1 h + X 2 h = G(t) h x + h y = u y . 
^From (|4.35|) we thus conclude that 

\ + vl G '(t)) u l 
XI (l + G(t) 2 )V2 

Combining (|4.34|) and Q4.36JI we obtain (|4.32|) . The proof of 1)4. 33() proceeds analogously, and 
we omit the details. 

□ 



(4.36) / \V H ' s h\ 2 da H = I ~ 7z " 9 ,/ /9 " dydt 



The next lemma is the keystone to the proof of Theorem 11.61 In order to state it, given an 
interval Is = (-45, 4(5), with 5 > 0, we fix a function % G Cfi°(R), such that < x( s ) < 1, X = 1 
on \s\ < 6, x = f° r l s l > 25, |x'| < C = C(S), and J R x( s )ds = 1. For every G N we define 
Xk(s) = x{ s /k)i so that Xfc(s) = 1 for |s| < 5k, Xk( s ) = for \s\ > 25k, and |x'fc( s )l — C/k, with 
C independent of k. We also let Xk( s ) = kx(ks), and notice that the f R Xk(s)ds = 1 for every 
k £ N, and that supp(x k ) C [— 2£/&, 25/fc]. 

Lemma 4.4. iet G G C 2 (Is) be such that G' > on I5. Define for k £ N 

Xk(y)x(t) 



fk(y,t) 



l + fG' fc (i) 



where we have let Gk(t) = G*Xk(t)- We have fk £ Cg°(IR x 1,5), and i/iere exists ko £ N suc/i 

f/iat /or aZZ k > k$ 

(4.37) 



f 1 + 1 \ 2 y _ G'(t) 

Ax/, 7l + G(t) 2 V iy ' 7 Ax/, (1 



j 4 V 1 + C(t) 2 V 9y ' 7 y Kx /, (1 + f G'W)v/l + G(i) 5 



fk{y,t) 2 dydt 
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Proof. We begin by observing that since G' £ C(I$), such function is uniformly continuous on 
[—28, 25]. We recall from basic properties of approximations to the identity that G' k = G' *Xk - ► 
G' uniformly on [—25, 25]. As a consequence of this, and of the fact that there exists e > such 
that G' > e on [—25, 25], we can find ^ 6 tf such that for all k > k$, and for all t G [—25, 25], 
one has 

(438) UG'(t) < GiW < 2ff( t ), 

We begin with the right-hand side of (|4.37|) . 



(4.39) (RHS) =4 / f k {y,tf\ G '^\ =) dydt 

V ' k ' k V ' \(2 + v 2 G'(t))Jl + G(tY 



(2 + y^G'{t))^l + G(t)\ 
-25 XW Vl + GW 2 Ur (2 + V 2 G'{t)) (2 + y2 G ^ t)) a " I ' 



25 yr+G(tF V7R(2 + y 2 G'(t)) 2 

2(5 , , 2 G'(t) ( V2tt \ , 
X(tf ; v 7 , eft 



2,5 



_ G'(t) 
V2tt / x(0 2 v , .» (it as k — > oo , 



25 



1 + G(t) 



where we have used (|4.38[) and Lebesgue dominated convergence theorem. 
On the other hand, we obtain for the integral in the left-hand side of (|4.37l) 

(4.40) 

2 2 + y 2 G'(t) f X ' k {yf 2y Xk (y) X ' k (y) G' k (t) Xk {yf G' k (tf 

x// 1 ' yrTW h + y 2 G' k (t) {2 + y^G' k {t)Y + (2 + y*G> k {t)Y ( ' ' 
X (t) 2 2 2 + y 2 G'{t) 



as ^TTGW i + y 2 G> k (t) 

,i 6 x{ ) ^TTGW( 2 + y 2 Gm 2[Xk{y) } y 

u ,2 G' k (t) 2 , , 2 y 2 {2 + y*G'(t)) 
Using the fact that 

d( y \_ 2-y 2 G' k (t) d(2 + y 2 G'{t)\ Ay (G'(t) - G' k (t)) 



dy\2 + y 2 G' k (t)J (2 + y* G' k (t))* ' dy \2 + y 2 G' k (t) J (2 + y 2 G' k {t)f 
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we integrate by parts the integral containing the term (xk(y) 2 ) j obtaining 



(4.41) 



xit? G ' k{t) y{2 + v G ' {t)) (x k (y) 2 )' dydt 

^2 G' k (t) ff Xk (y) 2 2 + y 2 G'(t) 



2 X(t) yi+W U (2 + V 2 G*(i) 3 ) a 2 + y 2 G k it) dy ) <!l 

x[t? Gm 2 Xk{yf y^±y^m dvdt 

Rx/j 



//, w Vl + G(t) 2 Vr v ' (2 + y 2 G' k {t)) 2 
Using (|4.41() in (|4.4UI) . and after canceling one term, we obtain for the left-hand side of (|4.37j) 



(4.42) { LHS) = L^^M)) 2 ^ 



X {t? ,, , 2 2 + y 2 G'(t) 



■ U xW yrrw U(2+ y 2 G' fc (i)) 2 2+ y 2 G ' fc(t) ^) 

N2 G' fc (t)(G'(t)-G^(t)) / /" / . , 2 4y 2 



= 4 + /J fe + //4 . 

We now analyze each of the three integrals in Q4.42JI . Using the fact that G'(t) > on Ig, we 
also have G' k (t) = G' * x k {t) > on 4- When k — » oo the first integral satisfies 



(4.43) 



, X(0 2 2 2 + y 2 G'(t) 

h = 1 vrrm Xkiy) ^m dydt 



k 2 J-2S V± + G(t) 2 \J-2ks 2 + y 2 G' k (t) 

ft r2S i / p2k8 \ qs-is: p2S , 

(by E33) < / ; / 2dy) dt = ^ dt 

~ k 2 J-26 y/1 + G'{t) 2 \J-2k5 J k L28 y/T+GW 



Similarly, letting k — > 00 we have for the third integral 
(4.44) 

k = 



1/4 = / x(t) 2G ^M=3^ ( [ x Uy) 2 ^^dy) dt 
1 V 1 + G(t) 2 Ur (2 + y 2 G' fc (t)) 2 y; 



(bygSEJ) < 16 sup |G' fe (t)-G'(t)| ( -£B= ( [ — V —-— d^\ dt 

tel-28,25] J-25 y/1 + G(t) 2 \M (2 + y 2 G' (t)) 2 J 
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from the uniform convergence of G' k to G' on [—25, 25]. Finally, we have 
(4.45) 

IIk =2 L xit) tttw \L¥Twmf^m) dy ) dt 



2,- yr+w VA(2 + y 2 G'(t) 2 ) 2 

-25 V / 1+W\8V / W)/ 4 

In the above, we have used (|4.38j) to deduce that for large enough k 
G' k (t) ( Xk {yf 2 + y*G>{t)\ < ^ G'(t) 




y/l + G{t)* V(2 + 2/ 2 ^(t)) 2 2 + y*G' k (t)J ~ yTTcW (2 + 2/ 2 G'(t)) 2 

and therefore, Lebesgue dominated convergence theorem applies. To summarize, we have as 
k — > oo 



(lhs) - L 04 ** - ^ />> 2 • 

Combining this with H4.39j) . we reach the sought for conclusion. 



□ 



We are now ready to prove Theorem 11.61 

Proof of Theorem M.GX Let S be a graphical strip, then there exist J C f , G £ C 2 (M), with 
G > 0, such that, after possibly a left-translation and a rotation about the t-axis, 5 can be 
represented in the form x = yG{t) for (y, t) € M. x I. If we assume further that S is a strict 
graphical strip, then we can find an interval J = (a, b) C /, such that G' > on J. Since 
the stability, or the instability, are invariant under left-translations and rotations, it will suffice 
to prove that S is unstable. Assume without restriction that — oo < a < b < oo, and set 
to = (a + b)/2, go = (0,0, —to). Consider the left-translated surface S = go ° S, see (|2.2[) . then 
S is described by 

x = y G(t) , (y,t) £RxI s , 

with 45 = (b — a)/2, and G(t) = G(to + t). Since it is clear that G' > on we can apply 
Lemma l4.4l and conclude that there exists ko £ N such that for k > ko the sequence fk satisfies 
()4.37j) . This being said, we now define h k : M 1 — > R as follows 

h k (x,y,t) = 1 = Xk(y)x{t)Xk{x - y G(t)) . 

^ + V -G' k (t) 

We observe that hk(0(y,t)) = fk(y,t)Xk(fy = fk(y,t), and therefore h k £ Cq(S). At this 
point, appealing to (|4.32|) in Lemma 14.31 and to Lemma 14.41 we conclude that for every fixed 
k > ko, we have 

vgcsj/ifci/*) < o . 

This proves that 5 is unstable, and therefore such is also the surface S. 

□ 



Remark 4.5. In particular, since every global minimizer is also a local one, we have also shown 
that S cannot be a global minimizer of the H -perimeter. 
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5. Instability of i7-minimal entire graphs and proof of the Bernstein conjecture 



In this section we prove Theorems II .71 and II .81 Our strategy will be to first establish Theorem 
II. 7\ and then combine this result with Theorem ll.6l to obtain Theorem ll.8l As we have mentioned 
in the introduction, our proof of Theorem 11.71 is based on the main results in GP , but we 
reiterate that an alternative proof could be obtained combining the results in the two papers 
|OHMY| and jCTTj . 

We begin by recalling the basic notion of seed curve from GP|. In what follows, fi C M 2 
denotes a given connected, open set of the (x, y)-plane, and / G C k (Q), with k > 2. We consider 
the graph of / over O 

(5.1) S = {(x, y, t) e M 1 | (x, y)eQ,t = f(x, y)} . 

We assume that S be oriented in such a way that N = V</> = (Xi<j))Xi + (X2<f>)X2 + (T<fr)T, 
were <f)(x,y,t) = t — f(x,y). From (|3.1|) we obtain 



y x If y\ 2 ( I^ 2 



V = Xtf = -U-*-, q = X 2 = -f y + -, W=yj[f x + ^ +[f y 
and thus we have from 

f 4- 1 f _ 2 
H Jx^r 2 j£ - Jy 2 X 

(/, + I) 2 + (/,-§) 2 1 y/(f* + $) 2 + (fv-tf 

away from S(<S). We stress that, since S is a graph over the (x,y)-plane, u H is independent 
of the variable t. Such crucial property would not be true for a graphical portion over the 
coordinate planes (y, t) or (x, t). We can thus identify in a natural fashion u H with a unit C fc_1 
vector field v onto the (x, y)-plane as follows (recall that k > 2). Given a point g = (z, t) € S, 
with z = (x,y), we let 



u H {z) - 
The notation 

[f> H ) L 



fx+2 fy 



(/, + f) 2 + (/,-f) 2 VC/. + D' + C/,-!) 2 



f — x f I 1 

Jy 2 Jx ~t~ 2 



(/, + I) 2 + (/,-f) 2 V(/, + I) 2 + (/, 



will indicate the unit vector field in Q perpendicular to v H (with respect to the Euclidean inner 
product u ■ v in M 2 ). 

Definition 5.1. Let S be a C 2 graph as in (|5.1|) . with = 0, and suppose that S be H- 

minimal. Given a point z G H C I 2 , a seed curve of S based at z is defined to be the integral 
curve of the vector field u with initial point z. Denoting such a seed curve by J z (s), we then 
have 

(5-2) j' z (s) = u H { lz {s)) , 7,(0) = z ■ 

We will indicate by C z (r) the integral curve of {i /H ) 1 ~ starting at the point z, i.e., 
(5.3) £» = (i> H )HUr)) , 4(0) = z . 

If the base point z is understood or irrelevant, we simply denote the seed curve by ^y(s), and 
C z {r)byC{r). 
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We emphasize that the assumption of i^-minimality on S, implies the crucial property that 
the vector field u H be divergence free in £1, with respect to the standard divergence operator 
in R 2 . As a consequence of this fact, it is proved in |GPj that the integral curves C z of (u^ 1 ) 1 - 
are straight-line segments. Furthermore, since \v H \ = 1 in f2, every seed curve is parameterized 
by arc-length, and it is a C 1 embedded curve in M. 2 over its interval of definition. The curves 
{£z,7z} are used in |GPj to define a local C 1 diffeomorphism of the (x,y)-plane given by 

(5.4) (s,r) -» (x(s,r),y(s,r)) d = f F(s,r) = 7 (s) + r (i> H ) ± ( 7 (s)) . 

We note explicitly that F maps the straight line r = into the seed curve 7 (s), i.e., 

F(s,0) = 7 (a) . 

On the other hand, the straight line s = is mapped into the straight line passing through 
the base point z of the seed curve and having direction vector (£>)-*- (z), i.e., 

F(0,r) = z + r {v H ) L (z) . 

One recognizes that F(0, r) = C z (r). In particular, when z = 7 (s) we obtain from this identity 

£rMM = 7W + r (^) ± (7(^)) ■ 

Along the seed curve we have (i' H ) ± ('j(s)) = j'(s) 1 - = (72(5)5 —j[(s)). One thus has the 
following explicit expression for F(s,r) 

(5.5) F(s,r) = 7 (s) + r 7 '(s)- L = (^fi(s) + r 7a (s) , j 2 (s) - rj[(s) 

Henceforth, given / G C fc (il) as in (|5.1|) . we will use the notation 

h(s,r) = f(F(s,r)) = /(71(a) + rj' 2 (s) , 72(a) - rj[ (s)) , 

for all values (s,r) for which the right-hand side is defined, and also let ho(s) = h(s,0). Notice 
that 

^0(0) = h(0,0) = /( 7 (0)) = f(z) . 

We next define 

(5.6) (s,r) — > F(s,r) = ( 7 i(s) + r 72 (a), 72 (a) - r 7l (s), h(s,r)) , 

and observe explicitly that .F(0, 0) = ( 7 (0), h(0, 0)) = (z,/(z)). We will need the following result, 
which is Theorem A in |GPj . This result shows, in particular, that, thanks to the assumption 
that S be .ff-minimal, the function h(s,r) must take up a special structure, see (|5.7|) below. 

Theorem 5.2. Let 5 c! 1 be a C k graph of the type (j5.1j) . with £(<S) = 0- //5 is H -minimal, 
then for every g = (z, t) G 5, t/iere exist intervals I, J, and an open neighborhood of g on S that 
can be parameterized by (|5.6|) . where h(s,r) is given by 

(5.7) fc(s,r) = h (s) - ^ 7 (a)- 7 '(a), (s,r)G/xJ, 

7 GC fc+1 (J), /i GC fc (/) • 



Corollary 5.3. Let S CM 1 be given as in Theorem \5.'A At every g = J-(s,r) G S, one has 
(5.8) W 



r 2 1 
h Q -r+ —k+ -7 -r 
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where W is the angle function defined in ()3.1|) . Moreover, the horizontal Gauss map is given by 



(5.9) 



v 11 = sgn (h' - r + jK + ]p' ■ jA j 



7 [(s) X l + 7 ' 2 (s)X 2 



Proof. Suppose that 6 : ft C M 2 -> H 1 , with 6{u, v) = x(u, v)Xi+y(u, v)X 2 + t(u, v)T be a local 
parameterization os S, then a direct calculation shows that the coefficients of N = 6 U A 9 V , and 
N H as in l|3.3|) . with respect to the orthonormal basis {Xi, X2, T}, are given by the equations 

P — Vufv Vvtu \(%uVv ^vVu) 1 
(5.10) < Q — X v t u X u t v -\- ~ 2 {x u y v ^vVu) ? 

^LO — %uDv %vVu ■ 

Applying the formulas (|5.1U|) to the parameterization 9(u,v) = !F(s,r) given by (|5.6j) . (|5.7|l . 
we find 



(5.11) 



p = 7i ( ^0 - r + t k + • r 
<i = ii [K - r + t k + h' ■ V 

= - (1 - rk) , 
where, following |GP| . we have denoted by 

<s) = 1 "(s)- 1 '(s) ± 
the signed curvature of the seed curve j(s). From Q5.11JI we obtain 



W 



p- 



r z I 
h'o ~ r + — K + - V • 7 J 



The assumption that the characteristic locus of S be empty implies that for every (s, r) in 
the domain of W(s,r), one has 

r 2 1 

^From the expression of W, and from (|5.11f) . we thus conclude that the horizontal Gauss map 
of S is given by (|5.9|1 . 

□ 



Theorem 15.21 admits the following converse, which is Theorem B in |GPj . 

Theorem 5.4. Given an interval I C R, > 2, a properly embedded plane curve 7 E C k (I), 
parameterized by arc-length, and a function ho £ C k (I), let S C H 1 6e i/ie surface parameterized 
by T : I xl as in (|5.6f) . u>i£/i h(s,r) given by (|5.7|) . Then, S is a C k ~ 1 H-minimal surface. 

Combining Theorems 15 . 21 and 15 .41 we conclude that to specify a patch of a smooth i?-minimal 
surface, one must specify a single curve in H 1 determined by a seed curve 7, parameterized by 
arc-length, and an initial height function h$. We will also need the following result, which is 
either Theorem A in |CHMY| . or Theorem E in |GPj . 

Theorem 5.5. Suppose that 5 Ci 1 be a connected H-minimal entire graph over the (x,y)- 
plane, then: 

(1) Either S is a plane of the form ax + by + ct = 7 for some real numbers a, b, c, 7, with 
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(2) Or, there exist g = (x ,y ,t ) G H 1 , a, b G E such that a 2 + b 2 = 1, and h G C 2 (R), 
suc/i that S is globally parameterized by 



We emphasize that both types of surfaces arising in this theorem have non-empty charac- 
teristic loci. For instance, in the case (1) we have = {(— 2b/c, 2a/c, 7/c))}. Finally, we 
recall a basic result in //-minimal surface theory. We mention that the next result is one half 
of Theorem C in [UP|, and of Corollary 4.2 in jCHMYj . 

Theorem 5.6. Let S be a C 2 , H -minimal surface without boundary, which is complete, con- 
nected and embedded, then S is a ruled surface, all of whose rules are horizontal straight lines, 
which are the integral curves of(u H )' L . 

After these preliminaries, we turn to the proof of Theorem ll.7l To prepare for it, we first show 
that an //-minimal surface satisfying the hypothesis of Theorem 11.71 can be reduced to an H- 
minimal graph over the (y, t)-plane, having similar properties. We will need some simple lemmas 
which clarify the effect of left-translations on a graph. As we have noted in the introduction, 
the left-translations (|2.2j) are affine transformations, thereby they preserve planes and lines, 
see (|1.6p . Moreover, the left-translations preserve the property of a surface of having empty 
characteristic locus, they preserve the //-mean curvature, and therefore the //-minimality, the 
//-perimeter, and the property of a surface of being stable or unstable. We note that rotations 
about the i-axis (the group center), also have the same properties. 

Lemma 5.7. Suppose P C H 1 be a plane with Euclidean normal of the form Np = (a,0,c), 
with a 2 + c 2 7^ ; and let S be a graph over P. For a fixed go = (xo,yo,to) G H ; go o S is a 
graph over a plane P with Euclidean normal vector given by N p = (a, 0, c — . 

Proof. For g = (x, y, t) G P, consider the straight-line through g and parallel (with respect 
to the Euclidean inner product in R 3 ) to Np, L(g) = {£ g (s) = g + s(a,Q,c) G M 1 | s G E}. 
The assumption that S be a graph over P implies the existence of a unique so G E such that 
L(g) n S = {lg(so)}. Consider the left-translated line go ° L(g), which is given by 



and note that go o l g (so) G go o S. We see that go o S is a graph over a plane P with Euclidean 



We are now ready to accomplish our first reduction. 

Lemma 5.8. Let 5 C i 1 be an H -minimal entire graph, with S(5) = 0, and assume that S 
is not itself a vertical plane such as ljl.2|l . After composing with a suitable rotation about the 
t-axis and with a left-translation, we may assume that there exist ip G C 2 (M?) for which 






□ 



S = {(x, y, i) £ i 1 (y, t) G M. 2 ,x = tp(y, t)} . 
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Proof. Suppose that S be a graph over the plane P given by ax + by + ct = 7 for a, 6, c, 7 £ R, 
with a 2 + b 2 + c 2 7^ 0. Suppose first that 6 = 0, and consider the two cases, a = 0, and In 
the former case, keeping in mind that c 7^ 0, we see that S is a graph over the plane t = 7/c. The 
left-translation by <?o = (0, 0, —7/c), sends this to the plane t = 0, and the surface go ^ becomes 
a global .ff-minimal graph, with empty characteristic locus, over the (x,y)-plane. This however 
contradicts Theorem 15.51 since this result forces such a graph to have non-empty characteristic 
locus. We must thus have In this case, left-translating by go = (0, — 2c/a, 0), Lemma 15*771 

shows that go o S is an entire graph over the (y,i)-plane. Thus, we can find ip £ C 2 (IR 2 ) which 
defines go° <S, thus yielding the desired conclusion. 

We are thus left with the situation b 7^ 0. In this case, however, performing a rotation of an 
angle 9 = cotan~ 1 (—a/b) £ (0, ir) about the i-axis, which preserves ^/-minimality, we obtain a 
new surface which is an entire graph over a plane having Euclidean normal in the form (a, 0, c), 
and we can thus argue as in the first part to reach the sought for conclusion. 

□ 

As it will be useful later, we next prove that the notions of seed curve and height function 
are preserved under left-translation. 

Lemma 5.9. Suppose there exist intervals I , J C R so that a portion, So, of an H -minimal 
surface, S, is parameterized by a seed curve, 7, and height function, ho, as in (|5.6I) and (|5.7|) . 
with s E I,r G J. If go = ( x o. Ho, to) £ EI , then the surface go <-> So is also parameterized as in 
(|5.6I) and (j5.7D . using a seed curve, 7, and height function, ho, given by 7(5) = (xo + 7i(s), yo + 
7 2 (s)), and h (s) = h (s) + ^(s) - fM s ), for s € I,r € J. 

Proof. With F(s,r) as in ()5.5|) . consider go o So, which is parameterized by go o ^"(s,r) = 
go o (F(s, r), h(s, r)). Using ()2.2|) . we see that go ° ^(s, r) is given by 

F(s,r) = (F(s,r),h(s,r)) , 

with 

F(s, r) = 7(5) + r(f (a))" 1 = 7 (s) + r( 7 , (s)) ± + (x , y ) , 

and 

h(s,r) = h (s) - -7(s)-7'(s) 

where /io( s ) = ^o(-5) + ^ i 72('S) — ^7i(s). Applying Corollary EU3 to the parameterization F(s,r), 
we find IU(s, r) = W(s, r), and therefore from (|5.9j) we obtain for horizontal Gauss map of go°So 
at the point go o (F(s, r), h(s, r)), 

S5 n (h'o-r+jK + ^'-^A | 7 i(s) Xi+ 7 ^( S )X 2 | . 

Since %(s) = 7 ^(s), we have that the components of the horizontal Gauss map are the same 
as those of the unit horizontal Gauss map for So at the point (F(s, r), h(s, r)), see Corollary 15. 31 
Upon projection to the plane t = 0, we have that 7', as a vector field on M 2 , is just a translation 
of 7' by the vector (xo,yo). Thus, 7 is a seed curve for 5o. 

□ 

We apply these results to a useful special case. 

Corollary 5.10. Suppose that S be a H-minimal entire graph over the (y,t) -plane with empty 
characteristic locus, and that S is not itself a vertical plane. There exist a point go £ S, an 
interval I C R, 7 G C 3 (I), ho £ C 2 {I), so that a neighborhood So of go can be parameterized by 
([QlLlfrrrjl for sel and r£R. 
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Proof. Since we assume S is a graph over the (y, i)-plane, there exists ip £ C 2 (R 2 ) such that 
S is described by x = ip(y,t). Consider the defining function ^(x,y,t) = x — ip(y,t). If 
\p t = ip t = 0, then we would have ip{y,t) = f(y), and by the //-minimality of S, we would 
conclude that f{y) = ay + (3, against the hypothesis that S is not a vertical plane. Therefore, 
there exists go £ S such that ipt(9o) 0- The Implicit Function Theorem implies the existence 
of a neighborhood of go on S which may be written as a graph over the plane t = (with empty 
characteristic locus). Applying Theorem 15.21 we obtain intervals I, C R, 7 G C 3 (I), ho £ C 2 (I), 
so that a neighborhood of go is parameterized by (|5.ti|) . (|5.7j) for s £ I, r £ J. To finish the 
proof, we need to show that for every s £ I, we may extend the domain of r to the whole of R. 
To see this, we note that for each so £ I, the curve 

r -> £ (7(so),Mso))( r ) = (7( s o) + r7 / (s )- L ,/i(s ,r)) , 
with h(s,r) given by l|5.7jl . and r £ J, is a horizontal straight line segment in H . Using (|5.7|) . 
we see that the tangent vector to this line is simply 

(5.12) (V(*o)V 7(So) 2 7/(S0) ) = 7 2 (*o) X 1 (T(s ,r)) - 7 1( S0 ) X 2 (^( fl0 ,r)) , 

which, by Corollary 15. 3( is precisely (iv^) -1 -. Thus, by the standard uniqueness theory for solu- 
tions to ordinary differential equations, these line segments must coincide with subsets of the 
horizontal line foliation of S guaranteed by Theorem 15.61 As the entirety of these horizontal 
lines are contained in S, we conclude that the parameterization given by (|5.6|) . (|5.7|) extends to 
(s,r) G I X R. 

□ 

In order to extract some crucial additional information from our assumption that S be a an 
entire graph with £(<S) = 0, the following elementary lemma will be useful. 

Lemma 5.11. Letg\,g2 Gi 1 , v = (vi,V2,vs),w = (wi,W2,Ws) £ R 3 , and consider the straight- 
lines Li = {gi + rv I r £ R} ; i = 1,2. If 7r : H 1 — > R 2 denotes the projection to the (y,t) -plane 
given by n(zi, Z2, t) = (0, 2:2, i), i/ien vr(Li) n vr(L2) = if and only if n(gi) 7^ vr^), v x w 
is (Euclidean) perpendicular to (1,0,0). 

Proof. Suppose vr(Li) n n(L2) = 0, then it is obvious that it must be Tv(gi) 7^ ^(32)- Fur- 
thermore, we must also have ir(v) x 7r(w) = (^2^3 — W2V3, 0,0) = 0. Thus, we conclude that 
(^2^3) and (w2,W3) are constant multiples of one another. But then v x w takes the form 
(■U2W3 — W2V3,*, *) = (0,*,*), and we conclude that v x w is (Euclidean) perpendicular to 
(1,0,0), one direction of the lemma. The opposite direction follows by simply reversing the 
previous argument. 

□ 

Next, we apply Lemma 15. Ill in the case of the parameterization given in Corollary 15.101 The 
following lemma plays a crucial role in the proof of Theorem 11.71 

Lemma 5.12. Let I C R, 7 £ C 3 (/), ho £ C 2 (I), and consider a portion Sq of an H -minimal 
entire graph S over the (y,t) -plane having empty characteristic locus. Suppose that Sq be pa- 
rameterized as in (|5.6j) . (|5.7|) for (s, r) 6 I X R. There exists a subinterval, J C I, such that 7 (J) 
is either a straight line segment, or a circular arc. 

Proof. By re-parameterizing 7, we may assume 6/. As in the proof of Corollary 15.101 for 
every fixed s £ I, we consider the horizontal straight lines contained in S, and defined by 

(5.13) £ (7W>hoW )(r)= {7(s)+n , (s) ± ,ho(s)-ll(s)- 1 '( S )) , r£R. 
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For every s £ / we consider the two lines L\ = £( 7 (o),k (o))> L 2 = £(7(«),ft (s))- The assumption 
that S be an entire graph over the (y, i)-plane implies, in particular, that for every s G I we must 
have tt(Li) n vr(L2) = 0. We can thus use Lemma 15,111 to infer that the directional vectors of 
L\ and L 2 , v = (7 / (0) ± , — ^7(0) • 7'(0)) and w = (7 , (s)- L , —^7(5) • 7'(s)), satisfy the condition 
that v x w be perpendicular to (1,0,0). A simple computation now gives 



(5.14) v x w ■ (1,0, 0) = ~ ( 7 ;(0)(7(s) • YW) - Vi W(7(0) • Y(0)) 

We first discuss three special cases. If 7^(0) = and 7(0) • 7'(0) 7^ 0, then for (|5.14|) to be 
satisfied we must have "f[(s) = for all s in a neighborhood J of s = 0. Hence, 7 (J) is a line 
segment and we have reached one of our conclusions. Similarly, if 7(0) -7'(0) = 0, but 7^(0) 7^ 0, 
then (|5.14|) is only satisfied if 7(s) • ^y'(s) = for all s in a neighborhood J of s = 0. In this case, 
we claim that 7 (J) is a circular arc. To see this, we note that d/ds(\<y(s)\ 2 ) = 27(a) • Y(«) = 
on J. Thus, |7(s)| = C > on J, hence j(J) is a circular arc, reaching the second of our 
conclusions. Last, if both 7(0) • 7'(0) = and 7^(0) = 0, then by the fact that |7'(0)| = 1, we 
obtain that 1 72(0)1 = 1. and, using ()5.13j) . we conclude that So contains the straight line 

£ (7 (o),fto(o))(r) = (7l(0) ±r, 72(0), ho(0)) , r G E . 

This clearly violates our assumption that So is a graph over the (y, i)-plane, as the whole line 
projects to the same point, (0, 72(0), ho(0)), in the (y, i)-plane, thus this case cannot occur. 

If we are not in any of these cases, then we must have that both 7^(0) 7^ and 7 • 7 ; (0) 7^ 0. 
By the continuity of 7 and 7', there exists a neighborhood of s = 0, J, such that j[(s) 7^ 0, and 
7(s) • Y(s) 7^ for any s G J. In this case we conclude that (|5.14|) is equivalent to the existence, 
for every s G J, of a C(s) 7^ such that 

Equating the first entries we find that C(s) = C 7^ for s G J, with 

7(0) • y (o) ' 

We conclude that 

(5.15) Y x (a) = C 7 ( S )-7'( S ) , sG J . 
Recalling that ^|7(s)| 2 = 27(5) • 7 ; (s), (|5.15j) implies 

(5-16) | 7 ( s )|2 = l 7l(s) + c 

where Co is an integration constant. We claim that this implies that 7( J) is a circular arc. To 
see this, we left-translate So by (— 1/C, 0, 0). Lemma 15.91 shows that the translated surface will 
have a seed curve given by ■j(s) = (7i(s) — 1/C,72(s)). Computing |7(s)| 2 and using (|5.16j) . we 
have 

| 7 (s)| 2 = | 7 (s)| 2 - - 7 i(s) + ^2 = §7i(s) - §7i(s) + ^2 + C = ^ + C . 
Thus, 7 ( J) is a circular arc and hence, such is 7 (J) as well. This completes the proof. 

□ 



With these preliminary computations in place, we are finally ready to establish our main 
reduction result. 
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Proof of Theorem \1.7\ Let S be an if -minimal entire graph over a plane P with empty 
characteristic locus and which is not itself a vertical plane. In view of Lemma 15.81 after possibly 
a left-translation and a rotation about the i-axis, we may assume that P is the plane x = 0, and 
that S is given by x = ip(y,t) for some i\) G C 2 (M?). Corollary I5.1UI guarantees that there exists 
go G S, an interval I C M, a unit-speed 7 G C 3 (I), ho G C 2 (I), so that a neighborhood Sq of g 
can be parameterized by 

(5.17) F(s,r) = [j( s ) + r 1 f (s) ± ,h Q (s)- r - 1 (s)- 1 '(s)) , (s,r)eIxR. 

Since S is a graph over the plane x = 0, Lemma 15.121 yields that j(J) is either a straight-line 
segment, or a circular arc. We next show that assumption of empty characteristic locus on S 
rules out the possibility that 'j(J) be a straight line segment. If, in fact, 7 were linear, then it 
would have the form 

7(s) = (x + ais, y + a 2 s) , 
with a 2 + a 2 . = 1. In this case, the signed curvature k(s) = 0, and the angle function W, given 
by ()5.8j) . becomes 



W(r,s) 



h' (s) -r + ^(aiy - a 2 x ) 



(s,r) G J x 



Since it is clear that, for each fixed s G J, there exists r G M, r = /i' (s) + \ (a\yQ — CL2X0), 
where W(s,r) = 0, we would conclude that S has a characteristic point at g = J-{s,r), against 
our hypothesis. 

Therefore, j(J) must be a unit-speed circular arc, i.e., 

(5.18) 7(s) = (x Q + Rcos(s/R),y + Rsm(s/R)) , 

for some (xo,yo) £ an d -R > 0, and (|5.17|) becomes 

F(s,r) = (x + (R + r) cos(s/R),y + (R + r) s'm(s/R), h (s) + ^(x s'm(s/R) - y cos(s/R))j 

Consider the left-translated surface So = (— xo, —yo,0) o So parameterized by 
(5.20) F(s,r) = (-x ,-y ,0)of(s,r) = ((# + r) cos (R + r) sin ~, ft ( S ; 

where 

ho(s) = h (s) + — (yo cos — - x sin — 

By Lemma f5.7l we know that the S = (—xo, —yo, 0)oS is a non-characteristic entire graph over 
a plane P, having Euclidean normal N = (1,0, —yo/2). Applying (|5.10|) to the parametrization 
!F(s, r) we obtain 

(5-21) U = cos s (^f-h' Q (s) 



R \ 2R 
R+r 
R 



Using (|5.21f) we immediately recognize that the angle function W for So is given by 

(R + r) 2 



W(s,r) 



h (s) 



2R 

Since W(s,r) ^ for any (s,r) G J x R, we conclude that we must either have 

(R + r) 2 ^ r l( , (R + r) 2 ~ 

— — — > h (s) , or — — — < h (s) 
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for every (s, r) G J X R. It is clear that for no fixed s G J can the second inequality hold for 
every r£l, and therefore we must have for every fixed s G J 

h' (s) < — — , for every r£K. 

2R 

This imposes that we must have the crucial property 

(5.22) h' (s) < , for every s£ J. 

Having achieved this conclusion, consider the portion So of S given by H5.20|) . The non-unit 
Euclidean normal to So is given by 

- h' (s) sin — , h' Q (s) cos — , — J , 

where the cross product is taken with respect to the Euclidean inner product in IR 3 . The 
Euclidean Gauss map of So is thus given by 

1 ( r, / x . s r , , . s R + r 



K( s ) sin - , h' Q 



S) cos 



R ' uv ; it! ' 



For any fixed s G J, letting r range over M, we see that the image of v e in 5" 2 C M 3 describes 
a curve, denoted F, which is an open arc of a great circle. We observe that V passes through 

the point (sin(s), — cos(s), 0) = (sin(s), — cos(s), 0), and that the closure of T contains the 

points (0,0, ±1). Since Sq is a graph over the plane P, we must have that v e {So) C S 2 lies 
entirely to one side of the plane determined by the vector — — L==(l, 0, — yo/2) G S 2 . Now, if 

yo 7^ 0, then the points (0, 0, ±1) G T would lie on opposite sides of this plane, thus reaching a 
contradiction. We conclude that we must have yo = 0, and therefore So is a graph over a portion 
of the (y, t)-plane. 

Since from (|5.20|) we see that x/y = cot(s/R), when s ^ 0, we fix an open sub-interval of J, 
J = (a, b), with either < a < b < n, or — tt < a < b < 0, and we consider the open interval 
I = h$(J). We stress that, in view of (|5.22l) we know that Jiq 1 : I — > J exists, and, depending 
on the choice that we have made of J, we have that either < Jiq 1 (t) < tt, or — tt < /i " 1 (t) < 0, 
for every t G I. We may thus re- write Sq as 

(5.23) x = y cot(/i - 1 (t)) = y G(t) . 

We note that G G C 2 (I) since h 1 G C 2 (I), and that moreover, thanks to (|5.22|) we have 

G'(t) = - (l + cot 2 ^ 1 ^))) 1 > 0. 

Wo (*)) 

Furthermore, since y = (R + r) sin(s/R) for s G J and r G M, we conclude that y attains every 
real number. In addition, we claim the map (r, s) G M x I — > ((R + r) s'm(s/R), ho(s)) eRx J 
is one to one. To see this, we consider (ri, si), (r%, s%) so that ((R + r\) sin(si/R), ho(si)) = 
((R + r2)sm(s2/R),ho(s2))- The injectivity of ho implies that s\ = S2, and so we must have 
ri = r2 as well. We thus see that the parametrization H5.23j) of S is valid for (y, t) G R X I. This 
completes the proof. 

□ 



With Theorem 11.71 in hands, we can now establish our main result of Bernstein type. 
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Proof of Theorem \1.8l Let S C H 1 be a stable if-minimal entire graph, with £(<S) = 0. 
Assume by contradiction that S is not a vertical plane. By Theorem II. 7\ after possibly a left- 
translation and a rotation about the i-axis, the resulting surface S contains a strict graphical 
strip Sq. By Theorem 11.61 we know that So is unstable, and therefore also S must be unstable, 
thus reaching a contradiction. We conclude that 5 must be a vertical plane. 

□ 



6. Obstruction to the higher-dimensional Bernstein problem 

In this section we prove Theorem ll.9l We begin with a simple proposition, which is fact valid 
in any Car not group. 

Proposition 6.1. Suppose that the hypersurface S C W 1 be a vertical cylinder, i.e., it can be 
represented in the form 

(6.1) S = {g = (x, y, t) G H n | t)(x, y) = 0} , 

where f) G C 2 (M. 2n ), and there exist an open set uj C K 2n and a > such that |Vfj| > a in uj. 
Under these assumptions, the characteristic locus of S is empty, and the H-mean curvature of 
S is therefore globally defined and it is given by 

(6.2) n(x,y,t) = (2n-l) H(x,y) , 

where H(x, y) represents the Riemannian mean curvature of the projection tt(S) of S onto M. 2n x 
{0}. In particular, S is H -minimal if and only if tt(S) is a classical minimal surface in R 2n . 
Furthermore, the H -perimeter of S, ajj(S), is given by 

(6.3) a H (S) = H 2n {S) , 

where H 2n is the standard 2n- dimensional Hausdorff measure inM. 2n+1 , i.e., the surface measure. 

Proof. Consider the defining function for S given by 4>(x,y,t) = t)(x,y). We first observe that 
for i = 1, n, 

df) dt) 

Xi4>(x,y,t) = — , X n+i (f>(x,y,t) = — , 

hence, since T<f> = 0, we conclude that 

(6.4) V H <f) = V4> = VJ) , 

which, thanks to the assumption |Vh| > a > 0, proves in particular that E(<5) = 0, and that 
v H = = v, where v denotes the Riemannian unit normal of S. Thanks to Proposition 12.41 
the H-mean curvature of S is given by 

2n In 

H = V f' 5 < » H > x i > = J^XiVi = divv = (2n- 1) H , 
i=i i=i 

where in the third and second to the last equality we have used (|6.4|) . This proves ()6.2|) . Finally, 
(|6.3|) derives from ()6.4j) and from (|3.5|) . or equivalently (|3.6|) . 

□ 
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Proof of Theorem \ Lift Consider the Heisenberg group HP, and denote by N + 1 = 2n the 
dimension of the horizontal layer M. 2n x {0}. For (x, y) G R 2n , we write y = (y',y n ), with 
y' G W 1 - 1 , and denote by R N = M% x R™, -1 - By the fundamental results in \BDG\ . given any 
N > 8 there exists a non-affine / G C"(R N ) such that S = {(x,y) G R 2n \ y n = f(x,y')} is an 
entire minimal graph. Clearly, if we consider the defining function f)(x, y) = y n — f(x, y') for So, 
then 

\Vi)(x,y')\ = ^l + |V x y/(x,y')l 2 > 1, for every (x, y') G R N . 

Consider the vertical cylinder S C HP such that ir(S) = So. Thanks to Proposition 16.11 
S is an i^-minimal entire graph, over the hyperplane {(x,y,t) G HP | y n = 0}, with empty 
characteristic locus, and which is not a vertical hyperplane. Using the fact that the unit vector 
field on S 

^ ( n n—1 

(x,y,t) -> v H = E(-/^)^ + J2(~fy^ X ^ + X * 

\A + |V*y/| 2 [f^ f^t 

is independent of the i-variable, and moreover div H u H = divv = 0, we can easily prove the 
stability of S similarly to the classical case, see [CM., pagg.1-4, and also |BSVj for a general 
discussion of sub-Riemannian calibrations in HP. Finally, we observe that the condition N > 8, 
translates into n > 9/2, hence a counterexample to the Bernstein problem can be found for any 
n > 5. 

□ 
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